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TIME INVARIANT FEATURE LOCATION METHOD AND SYSTEM 

TECHNICAL FIELD OF THE INVENTION 

This invention relates generally to image processing and more particularly to a 
time invariant feature location method and system. 

RELATED APPLICATIONS 
5 This application Claims the benefit of U.S. Provision Application Serial No. 

60/174,073 entitled DIGITAL FILM PROCESSING FEATURE LOCATION 
METHOD AND SYSTEM. This application is related to the following co-pending 
applications filed on December 30, 1999; Serial No. 60/174,074, entitled METHOD 
AND SYSTEM FOR ESTIMATING SENSOR DARK CURRENT DRIFT; Serial 
10 No. 60/173,781, entitled PULSED ILLUMINATION SIGNAL MODULATION 

CONTROL AND ADJUSTMENT; Serial No. 60/173,787, entitled DIGITAL FILM 
PROCESSING METHOD AND SYSTEM; and Serial No. 60/173,780, entitled 
METHOD AND SYSTEM FOR ESTIMATING SENSOR AND ILLUMINATION 
NON-UNIFORMITIES. 
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BACKGROUND OF THE INVENTION 

The process of producing images from film typically includes obtaining data 
from the film and producing image data in a variety of forms. For example, the 
process may produce photographic prints, slides, and/or digital representations 

5 thereof. Usually the process of scanning data from film results in surplus data with no 

image content, such as data obtained from unexposed regions of the film. This 
surplus data is outside of the extents (that is, one or more outermost regions of the 
image data) of the images on the film. Separation of the image data from this surplus 
data is typically a complex and time-consuming process. Cropping techniques may 

10 be employed to improve the appearance of the images by separating the image data 

from the surplus data obtained from the film. However, these techniques may not 
provide the flexibility to be used with a variety of digital film processing systems. 
For example, where the film is developing, characteristics of the film and/or any 
developing chemical applied thereto vary as the film develops, and may affect the 

1 5 accuracy of these cropping techniques. 

In addition, processing images from film typically includes capturing digital 
data from the film with a sensor as the film is illuminated with a light source. 
Because the illumination levels captured by the sensor represent the image data, any 
sensor or illumination non-uniformities introduce undesirable errors into the data 

20 measurements. Unfortunately, sensor and illumination characteristics typically vary 

individually and can drift over time due to factors such as heating and/or transient 
responses in the devices when they are activated and deactivated. Obtaining digital 
image data from developing film presents additional challenges. Where the film is 
scanned while being developed, variances in film and chemical developer 

25 characteristics often arise due to changes that take place during the development 

process. These variations often affect the quality of the resultant image. 
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SUMMARY OF THE INVENTION 

From the foregoing, it may be appreciated that a need has arisen for providing 
a time invariant feature location method and system. In accordance with the present 
invention, a system and method are provided that substantially reduce or eliminate 
disadvantages and problems of conventional systems. 

One aspect of the invention is a method for improving the quality of image 
data. The method comprises the step of identifying a reference feature whose 
characteristics are invariant as the film develops. The method also comprises the step 
of adjusting image data in response to the reference feature, where the image data and 
the reference feature captured from the film while the film has developing chemical 
applied thereto. 

The invention provides several important advantages. Various embodiments 
of the invention may have none, some, or all of these advantages. For example, the 
invention may effectively create, identify and/or locate various time invariant features 
in film while the film is developing. These features may be used as reference data 
that may be used to adjust image data, thereby improving the quality of resultant 
images derived therefrom. For example, the invention may locate image extents and 
unexposed regions of film while the film is developing and thus facilitate the removal 
of surplus data outside these extents. In some applications, such an advantage may 
reduce the storage space used to capture data from a roll of film and may further 
reduce computing resources used to manipulate the captured image data. 

Location of one or more unexposed regions of film may provide a window of 
opportunity to measure data that may be used to correct and/or adjust captured image 
data. For example, the invention may capture measurements such as white levels that 
may be used to normalize and/or equalize captured image data, thus improving the 
accuracy thereof. 

The invention may provide the flexibility to be used with a variety of digital 
film processing systems and a variety of film types. For example, the invention may 
be used with data that was obtained from film while the film was developing. The 
invention may also be with scanners, and/or systems that capture digital data from the 
film with a sensor as the film is illuminated with a light source. The invention may 
also be used with systems that capture data for an entire roll of film or a portion 
thereof, including unexposed regions of the film that typically include no image data. 
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Other technical advantages may be readily ascertainable by those skilled in the art 
from the following figures, description, and Claims. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the present invention and the 
advantages thereof, reference is now made to the following descriptions taken in 
conjunction with the accompanying drawings in which: 
5 FIGURE 1 illustrates an example of a digital film processing system that may 

be used in accordance with the invention; 

FIGURE 1 A illustrates a cross section of film from which image data may be 
captured; 

FIGURE 2A illustrates an example of an image capture engine that comprises 
10 an embodiment of the present invention; 

FIGURE 2B illustrates another example of an image capture engine that 
comprises another embodiment of the present invention; 

FIGURE 2C illustrates another example of an image capture engine that 
comprises another embodiment of the present invention; 
15 FIGURE 3 illustrates an example of a method for capturing and adjusting 

image data in response to time invariant feature data in accordance with the present 
invention; 

FIGURE 4 illustrates an example of a method for locating an unexposed 
region of film while it is developing in accordance with the present invention; 
20 FIGURE 5 illustrates an example of a method for locating the top and bottom 

extents of images in accordance with the present invention; and 

FIGURE 6 illustrates an example of a method for locating time invariant 
features in film using an expected signature in accordance with the present invention. 

25 
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DETAILED DESCRIPTION OF THE INVENTION 

The preferred embodiment of the present invention and its advantages are best 
understood by referring to FIGURES 1-6 of the drawings, like numerals being used 
for like and corresponding parts of the various drawings. A variety of time invariant 
5 features may be created, detected and/or located during digital film processing. Time 

invariant features may be considered those features whose locations and 
characteristics on film do not change, even when viewed from multiple angles or as 
film develops. These features may be detected by various methods including, but not 
limited to, threshold detection, periodic feature detection, adaptive filtering, and the 

10 use of histograms. These features may also be used to facilitate processing of image 
data where the data may be obtained at various film development times. These 
features may be used as reference features to adjust image data captured during digital 
film processing. For example, these reference features may be used for image frame 
detection, image alignment, normalization, equalization and/or noise correction, 

1 5 among other things. 

FIGURE 1 illustrates an example of a digital film processing system 10 that 
comprises an embodiment of the present invention. Digital film processing system 10 
comprises film dispenser 22, at least one transport mechanism 23, a developer station 
24, a processor 36 and at least one input/output device 25, and at least one sensor 

20 station 40. Digital film processing system 10 is operable to capture and/or adjust data 

captured from a film 60 that is disposed proximate to and/or may move at a scan rate 
relative to sensor station 40. 

It may be illustrative to utilize a coordinate system to describe digital film 
processing system 10. For example, sensor station 40 may be disposed in a z 

25 direction proximate to, and may be moved at a scan rate relative to, a film 60 operable 

to store latent image data, such as film. Film 60 may be disposed, for example, in an 
x-y plane and have a width W in the y direction. By way of example and not by 
limitation, film 60 may be disposed in a generally vertical orientation, and/or may not 
be disposed within any single plane, but rather move through a plurality of 

30 orientations as sensor station 40 captures image data therefrom. As another example, 

film 60 may be disposed in a mobius strip configuration so that sensor station 40 may 
capture image data from both portions 64 and 66. Sensor station 40 may also be 
disposed proximate to and oriented in various angles relative to film 60. 
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At least one sensor station 40 is operable to obtain image data from film 60, 
even while the film may have developing chemicals applied thereto. In other words, 
the film may be developing, or may be completely developed. Developer station 24 
may be used to apply a thin layer of a developing chemical to film 60. By way of 

5 example and not by limitation, developer station 24 may be a slot coater or vibrating 

dispenser that sprays or otherwise applies the developing chemical to film 60. 
Transport mechanism 23 may be used to move film 60 at a desired scan rate relative 
to sensor station 40. Film dispenser 22 may be used to retain film 60 and to guide the 
film onto transport mechanism 23. 

10 Sensor station 40 may be used to capture image data from film 60 and 

transfers the image data to an input/output device 25 such as a storage medium. 
Sensor station 40 comprises optics 46, light source 50, sensor 52, sensor control 42, 
and illumination control 43. Sensor 52 operates in concert with light source 50 and 
optics 46 to capture or obtain image data from a film 60 such as film. 

15 Any suitable light source 50 and compatible sensor 52 such as those typically 

used in image processing applications involving photographic images may be used to 
capture image data for this aspect of sensor station 40. That is, sensor 52 may be any 
detector whose quantum efficiency, or responsivity, is compatible with a spectrum 
utilized by light source 50. For example, where light source 50 comprises mostly 

20 infrared or near-infrared energy, or energy outside the visible spectrum, sensor 52 is 

responsively operational to such wavelengths. Such an embodiment may be 
advantageous when digital film processing system 10 is used to capture image data 
from developing film because, for example, unexposed film is typically very 
reflective when illuminated with infrared energy. Such an advantage may facilitate 

25 location of time invariant features such as unexposed regions of the film. Other 

combinations of light source and sensors may also be used. Other examples may 
include, but are not limited to, a light source comprising a single column point source 
coupled to a scan mirror that may be operated in conjunction with a sensor comprising 
a point detector coupled to the scan mirror. 

30 In some applications, sensor 52 may comprise a plurality of charge-coupled 

devices (CCDs), photo diodes, or CMOS sensors. For example, sensor 52 may 
comprise a digital camera comprising a two-dimensional array of CCDs operable to 
capture data from a two-dimensional field of view in film 60. Sensor 52 may also 
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comprise a generally linear one-dimensional array, where the array comprises a 
plurality of detectors such as CCDs. Sensor 52 may also comprise a generally linear 
array of 4,096 (or any other number) detectors that may be, for example, staggered or 
linearly aligned within the array. The generally linear array may be operable to 
5 capture a data or image column over a generally linear field of view that spans width 

W (in the y direction) of film 60, or a portion thereof. 

Each detector within sensor 52 typically varies in thickness of coating, 
photoemissive characteristics, optics, etc., and thus typically varies in responsivity to 
a given amount of illumination. The responsivity of each detector also varies due to 

10 noise, age, and temperature. Such variation in responsivity to illumination within 

each sensor typically results in spatial non-uniformities in the image data. For 
example, where sensor 52 comprises a generally linear CCD array, variations in the 
efficiency of each detector in converting photons to electrons results in variations in 
illumination levels measured by each detector, regardless of variations in the film 60 

1 5 and/or content therein. 

A system signal-to-noise ratio may be measured by a combination of sensor 
responsivity and illumination characteristics of each sensor station. This signal-to- 
noise ratio may be improved by selecting sensor 52 for its sensitivity to intensity and 
wavelength illumination. Further improvements to the accuracy of captured data, and 

20 thus to image quality, may also be obtained by matching captured electron levels in 

sensor 52 to a full dynamic range for each latent image within film 60. For example, 
the capacity of wells for each detector, that is, the number of photons it may convert 
to electrons affects the range of discrete digital levels measurable by each detector, 
regardless of data content within film 60. Wells within sensor 52 may be desirably 

25 sized to be sufficiently large to accommodate desired image signal-to-noise ratios. In 

addition, digital film processing system 10 may adjust integration time for sensor 52 
and/or adjust the illumination power of light source 50 in order to maximize usage of 
the capacity of each detector well within sensor 52. 

hi one embodiment of the invention, light source 50 may be arranged in a 

30 wave guide. Each wave guide may comprise a plurality of illuminators, such as light 
emitting diodes (LEDs). Light may be reflected back through wave guide 50 from 
film 60 to sensor 52. Any suitable optics 46 for use with light source 50 and sensor 
52 may be used to produce desired optical effects in the image captured by sensor 52. 
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For example, optics 46 may be used to focus, magnify or enlarge data in film 60 to a 
desired image resolution for an application, such as 12 jam per pixel. Optics 46 and 
light source 50 may be manually or automatically controlled by, for example, 
processor 36. 

5 Processor 36 may be used for image data processing and adjustment in 

accordance with the present invention. Processor 36 may also control the operation of 
sensor station 40 by using sensor control 42 and/or illumination control 43. 
Alternatively or in addition, processor 36 may control sensor station 40 by, for 
example, executing software that maybe stored in an input/output device 25 such as a 

10 storage medium. Although a single input/output device 25 has been illustrated for 

simplicity, input/output device 25 may comprise multiple storage media as well as 
comprising storage media of different types. Moreover, although illustrated as 
separate units, processor 36 may perform some, none, or all of the logic functions 
described as being performed within illumination control 43 and/or sensor control 42. 

15 Specifically, processor 36 may be used to execute applications comprising 

image data processing and adjustment software. Image data processing and 
adjustment may be performed using special purpose digital circuitry contained either 
in processor 36, or in a separate device. Such dedicated digital circuitry may include, 
for example, application-specific integrated circuitry (ASIC), state machines, fuzzy 

20 logic, etc. Processor 36 may also comprise a portion of a computer adapted to 

execute any of the well known MS-DOS, PC-DOS, OS2, UNIX, MAC-OS and 
Windows operating systems or other operating systems, including nonconventional 
operating systems. Processor 36 may comprise random access memory (RAM) 36a 
and read only memory (ROM) 36b, and may be coupled to one or more input/output 

25 devices 25. These devices may include, but are not limited to, printers, disk drives, 
displays and a communications link. Disk drives may include a variety of types of 
storage media such as, for example, floppy disk drives, hard disk drives, CD ROM 
drives, or magnetic tape drives. 

Input/output device comprising a communication link may be connected to a 

30 computer network, a telephone line, an antenna, a gateway, or any other type of 

communication link. Image data captured from other than digital film processing 
system 10 may also be adjusted in accordance with the invention. For example, 
processor 36 may be coupled to an external network that may be used to obtain image 
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data, such as a scanner or camera system. Captured image data may then be provided 
to processor 36 from a computer network over the communication link. 

The present invention includes programs that may be stored in RAM 36a, 
ROM 36b, or input/output device 25 such as one or more disk drives, and may be 
5 executed by processor 36. In this embodiment, image data adjustment may be 

performed by software stored and executed by processor 36 with the results stored in 
an input/output device 25 comprising any suitable storage medium. Image data may 
be processed as it is obtained, after all data has been captured, or a combination 
thereof. 

10 Illumination control 43 may be used to control the amount of optical energy 

given off by light source 50, both in time and in amplitude. For example, it may be 
desirable to adjust the output optical energy from light source 50 if sensor 52 is 
saturating, or if illumination levels are otherwise determined to be too high or too low. 
Illumination control 43 may also include additional circuitry used to interface the 

1 5 logic with light source 50. 

Sensor control 42 may be used for data transfer and/or processing and to 
control activation and deactivation of sensor 50. For example, sensor control 42 may 
convert an analog signal to a digital pixel value, or transfer pixel data stored in sensor 
52 where sensor 52 has an internal memory. In some applications, sensor 52 may also 

20 comprise logic, such as a programmable processor, that may adjust or process pixel 

data as desired, before the pixel data is transferred into a memory or storage medium. 
Such a processor may perform the functions of sensor control 42. In addition, sensor 
control 42 may also include a bias control to improve system dynamic range. For 
example, sensors may retain residual charge that decreases the amount of usable 

25 sensor capacity, for example, in shift registers, a phenomenon known as image lag. 

Sensor control 42 may desirably increase the system dynamic range by applying a 
bias to sensor 52 to reduce the effect of this residual scene content on newly captured 
image data. Sensor control 42 may comprise software, hardware, or a combination 
thereof. 

30 Sensor control 42 may also be used to control activation and deactivation of 

sensor 52, independently of or in conjunction with light source 50. For example, 
sensor 52 may comprise a mechanical or electronic shutter mechanism for controlling 
a dwell or integration time in which the sensor may convert a number of photons 
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received into electrons. When light source 50 is activated, sensor 52 integrates over 
an interval of time signals reflected from film 60. By so controlling a combination of 
illuminated power and sensor integration time, digital film processing system 10 may 
adjust an amount of illumination measurable by sensor 52 and thus system dynamic 
range as desired. 

Digital film processing system 10 may obtain data from many kinds of 
images, such as color photographic images (either negative print or transparency), 
black and white images (either negative print or transparency and including black and 
white images derived from photographic film with multiple layers), other 
monochromatic images, x-rays, or any other type of image stored on film 60. Digital 
film processing system 10 may capture data from any tangible film 60 that may both 
reflect back and pass through illumination from a light source. One example of film 
60 is discussed in conjunction with FIGURE 1 A. 

FIGURE 1A illustrates an example of a cross-section of film from which 
image data may be captured. Color film 60 typically comprises three color emulsion 
layers - e.g., a blue layer 27, a green layer 28 and a red layer 29 ~ that are stacked on 
an antihalation layer 30. These four layers are typically stacked on a transparent base 
substrate layer 31. Each of these layers and their density affect the incident angle of 
light transmitted through the film and thus the illumination levels measured by sensor 
52. In some applications, a developing chemical layer 26 maybe applied to film 60. 

Film types vary with respect to the density of the antihalation layer, layer 
configuration, and thickness of the base layer. The density of film may also vary with 
respect to image content therein. For example, photographic film contains grains held 
on a substrate, such as silver-halide, as part of its physical makeup. These grains are a 
function of the latent image on the film, as well as the type and format of the film, 
with faster-speed and smaller-format film exhibiting more graininess. 

Developing chemical layer 26 may vary in thickness in the z direction between 
different points on the film, and may also affect the apparent density of the film. 
During a film development process, grains within the film that were exposed to the 
most light are the first to develop, and other grains develop as the development 
process continues. Those areas in which the most grains develop for a given layer 
will have the greatest density and lowest resultant pixel values. For example, images 
may contain areas of low-light shadows that contain many more grain traces than 
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areas of bright sky. In addition, as film develops, it increases in density as_silver is 
formed from compounds within the film, thus permitting latent images to be obtained 
by sensor 42. 

Sensor 52 is operable to measure light intensity within a spatial location of an 
image in film 60, even while film 60 is developing, or still has developing chemical 
applied thereto. These measurements may be obtained from silver formed from 
compounds within film 60, rather than from dyes within each of layers 27-29 after the 
developing chemical has been removed. Each intensity value associated with the 
intensity of light at that spatial location in the original image in film 60 corresponds to 
one of a series of pixels within an image as captured and/or stored by image capture 
engine 34 (FIGURE 2A). The intensity refers generally to a pixel's brightness. For 
example, a white pixel has greater intensity values than a gray or black pixel. Thus, 
for pixels that comprise eight bits of resolution, a black pixel typically has an intensity 
value of close to zero, whereas a white pixel has an intensity value of close to 255. 
The range of light intensities within an image on film may be referred to as a dynamic 
range of the image. The use of white and dark pixels as used in this specification is 
not meant to impart any meaning to the content of image data. For example, white 
and dark pixels within a film negative would have the opposite meanings for a 
positive image print. 

FIGURE 2A illustrates an example of image capture engine that comprises an 
embodiment of the present invention. Image capture engine 34 may be a portion of 
digital film processing system 10 and comprises processor 36, storage medium 38 and 
sensor station 40. Image capture engine 34 may also capture data from film 60, 
including a fixed reference point 70, an exposed region 71, and a leader 73. 

Film 60 is illustrated with a width W in the y direction measured between a 
top edge 72 and a bottom edge 74. Film 60 may comprise a single image frame Ii, or 
a plurality of image frames I t — I n disposed along the film in the x direction. Each 
image frame Ii-I n may be the same or a different size. For example, image frame Ii 
may be an image represented by a x b pixels, where a and b are any integer. That is, 
image Ii includes a plurality of a pixels or columns in the x direction, and b pixels or 
rows in the y direction. For example, each image frame Ii-In may include 1024 x 
1024 pixels, where a = b = 1024. 
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A plurality of image frames Ii-I n is illustrated to discuss one aspect of the 
invention. In commercial films 60, each of these image frames Ii-I„ may be separated 
by an unexposed region R u . Film 60 may also comprise an unexposed region R t 
between a top extent T]-T n of each image frame Ii— I n and top edge 72, and an 
unexposed region R b between a bottom extent B]-B n of each image frame Ii-I„ and 
bottom edge 74. In some films 60, unexposed regions R t and/or R b may also include 
one or more sprocket holes 76. 

Because each image comprises variable content, image capture engine 34 may 
create opportunities for creating, identifying, and locating time invariant features that 
may be used to improve the accuracy and/or quality of digital images derived from a 
variety of film types. Film 60 typically includes a number of time-invariant features, 
at various locations. For example, although the characteristics of images Ii-I n 
typically change as film 60 develops, other features such as film scratches, defects, 
and unexposed regions R u , R t , Rb and sprocket holes 76 do not. In addition, many 
commercial films 60 include a plurality of small spheres, typically glass. These 
spheres reflect light, and are typically imbedded in emulsion layers of film 60 to 
prevent surfaces of film 60 from adhering to one another. In addition to being time- 
invariant, some of these features may typically be periodic; that is, each feature is 
repeated at a substantially regular, or periodic, interval throughout film 60. Some or 
all of these time-invariant feature data may provide additional information that may 
be used as a reference for a variety of processing and/or adjustment of captured image 
data that may be performed by image capture engine 34. 

For example, image capture engine 34 may utilize one or more of these 
regions of unexposed film, which comprises a relatively uniform region of the highest 
light intensities, to determine white levels. In addition, a feature such as exposed 
region 71 may be created to determine dark levels. This may desirably maximize the 
mapping of expected intensity values of each location to all usable pixel values (for 
eight-bit data, there are 256). For example, in this embodiment, an area of exposed 
film 71 and/or unexposed film - the leader 73 ~ precedes a plurality of latent image 
regions or frames. Each image frame is also typically separated by an unexposed 
region or gutter R u . Image capture engine 34 may identify the highest and lowest 
pixel values to be expected at the time of image data capture. White levels as used in 
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this specification may be defined as the highest pixel or signal value expected to be 
measured by sensor 52. 

Exposed region 71 may be automatically or manually created by, for example, 
exposing an area of film 60 to bright light before a development process begins. 
Image capture engine 34 may determine dark levels for each detector within sensor 52 
by capturing data from exposed region 71. Dark levels as used in this specification 
may be defined as the lowest pixel or signal value expected to be measured by sensor 
52. The use of white and dark levels as used in this specification is not meant to 
impart any meaning to the content of image data. For example, white and dark levels 
within a film negative would have the opposite meanings for a positive image print. 

To illustrate this aspect of the invention, sensor 52 may comprise a generally 
linear array operable to capture a data or image column over a generally linear field of 
view that spans width W (in the y direction) of film 60, or a portion thereof. For 
example, FIGURE 2A illustrates a column I^ n) that represents data that may be 
obtained from film 60 from one column in the y direction through image Ii at row x = 
n. Column /, ^ also may include a pixel y c approximately centered therein. Data 
within column J t may be used to locate at least a portion of top edge T u bottom 
edge Bi, and/or top edges T 2 -T n and/or bottom edges B 2 3 n by using a method similar 
to the one discussed in conjunction with FIGURE 5. Data within column ^ may 
also be used to locate features such as unexposed regions R u and/or sprocket holes 76 
using a method such as the one discussed in conjunction with FIGURE 6. 

In operation, image data is captured from film 60 by, for example, sensor 
station 40, and is transferred to a storage medium such as storage medium 38. Image 
capture engine 34 may create, identify and/or locate applicable time invariant feature 
data as desired, before, during, and/or after image data has been captured from film 
60, and in any combination. By utilizing these time invariant features, image capture 
engine 34 may improve the quality of the resultant digital images by, for example, 
serving as reference data for image normalization and/or equalization, and noise or 
defect correction. 

FIGURE 2B illustrates another example of an image capture engine that 
comprises an embodiment of the present invention. Image capture engine 34 may 
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also be a portion of digital film processing system 10 and comprises processor 36, 
storage medium 38 and sensor stations 40 and 41. Sensor stations 40 and 41 may be 
used to capture image data from film 60 and may be similarly configured, operated 
and/or controlled. For example, similar to sensor station 40 as discussed in 
conjunction with FIGURE 1, sensor station 41 may be disposed in a z direction 
proximate to, and may be moved at a scan rate relative to, film 60. Film 60 may also 
move through a plurality of orientations as both sensor stations 40 and 41 capture 
image data therefrom. Sensor stations 40 and 41 may also be disposed proximate to 
and oriented in various angles relative to film 60. 

Sensor station 41 comprises optics 47, light source 51, and sensor 53, and may 
also comprise its own sensor and illumination control 48 and 49. Alternatively, 
sensor station 41 may share sensor and illumination controls 42 and 43 with sensor 
station 40. In this embodiment, sensor station 40 may be located proximate to the top 
surface 64 of film 60, and sensor station 41 may be located proximate to bottom 
surface 66 of film 60. Sensors 52 and 53 operate in concert with light sources 50 and 
51 and optics 46 and 47 to capture or obtain image data from film 60. Light sources 
50 and 51 may utilize the same or different frequencies. 

Sensor station 40 and sensor station 41 may be used to measure illumination 
levels through various incident angles of light reflected from and/or passed through 
film 60 to generate a resultant image. For example, sensor 52 may be used to capture 
light from light source 50 reflected from film 60 and/or light from light source 51 
illuminated through film 60. Similarly, sensor 53 may be used to capture light from 
light source 51 reflected from film 60 and/or light from light source 50 illuminated 
through film 60. Sensor stations 40 and 41 may be used to obtain four views of an 
image in film 60. A first view may be obtained by illuminating light source 50 and 
measuring energy levels within sensor 52 as it captures light reflected from film 60. 
Approximately simultaneously, sensor 53 may also capture image data as light from 
light source 50 is directed through film 60. Light source 50 may then be dimmed and 
light source 51 may be illuminated to obtain third and fourth views captured by light 
reflected from film 60 by sensor 53, and light illuminated through film 60 by sensor 
52. In embodiments where light sources 50 and 51 utilize different frequencies, four 
views may also be obtained without dimming either light source. 
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Processor 36 may control the operation of sensor stations 40 and 41 by using 
sensor controls 42 and 48 and/or illumination control 43 and 49. Alternatively or in 
addition, processor 36 may control sensor stations 40 and/or 41 by, for example, 
executing software that may be stored in storage medium 38. Also alternatively or in 
addition, processor 36 may comprise two individual processors. Each of these 
processors may control a respective sensor station. 

Similar to illumination control 48 as discussed in conjunction with FIGURE 
2A, illumination control 49 may be used to control the amount of optical energy given 
off by light source 51, both in time and in amplitude. Sensor controls 42 and 48 may 
be used to control activation and deactivation of sensors 52 and 53 respectively, 
independently of or in conjunction with light sources 50 and 51. Sensors 52 and 53 
may integrate over a different intervals of time signals reflected from and transmitted 
through film 60 from light sources 50 and 51. Each sensor 52 and 53 may integrate 
over a unique interval of time that may vary. Image capture engine 34 may thus 
control a combination of illuminated power and sensor integration time as desired. 

This embodiment may also create, identify, and/or locate a variety of time- 
invariant feature data as discussed in conjunction with FIGURE 2A. For example, 
white levels may also be captured for each of these four views, and be used for 
subsequent image data adjustment as discussed in conjunction with step 310. As 
another example, these four views may be aligned by using locations of feature data 
such as sprocket holes 76. Image capture engine 34 may later adjust and combine the 
image data captured from one or more views by sensor stations 40 and/or 41 into 
various representations of one or more single images. 

FIGURE 2C illustrates another example of an image capture engine that 
comprises an embodiment of the present invention. In this embodiment, image 
capture engine 34 may also be a portion of digital film processing system 10 and 
comprises additional sensor stations 40a and 41a to monitor the reaction of 
developing film at one of a plurality of development times for the film. In some 
applications, sensor stations 40a and 41a may be disposed proximate to and at various 
intervals along the x direction of top portion 64 and bottom portion 66. Film 60 may 
move relative to these sensor stations at one or more scan rates where, for example, 
more than one transport mechanism 23 may be used. Each sensor station may be 
controlled with a common processor 36, or may be controlled with its own processor 
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(not explicitly shown). Any number of additional sensor stations 40a and/or 41a may 
be used within the scope of the invention. 

Image capture engine 34 may later adjust and combine the image data 
captured from the plurality of sensor stations 40 and/or 41 into various representations 
5 of one or more single images. These additional sensor stations may provide 

additional information with respect to various time-invariant features within film 60 
and/or variances in film characteristics as film 60 develops. For example, thresholds 
may be adapted as film develops and it captures more light as the density of silver 
increases. Furthermore, image capture engine 34 may also utilize none, some, or all of 

1 0 these time-invariant features as a constant reference to align image data captured with 

these other additional sensor stations. By utilizing a plurality of locations for these 
feature data produced by these sensor stations, the image data may be adjusted to 
more accurately reflect the location of image frames. For example, image capture 
engine 34 may utilize data such as the location of fixed reference point 70 in 

15 conjunction with time invariant features such as image extents Ti and Bi, and/or 

sprocket holes 76, as described in conjunction with FIGURES 5 and 6. In addition, 
because of their periodic nature, image capture engine 34 may utilize some of these 
features to, for example, predict the location of gutter regions and/or image frames 
using information derived from the different sensor stations 40, 41, 40a, and 41a by 

20 measuring locations with regularly spaced sprocket holes 76. 

FIGURE 3 illustrates an example of a method for capturing and adjusting 
image data in response to time invariant feature data in accordance with the present 
invention. While sensor station 40 is used to illustrate this aspect of the invention, the 
method discussed in conjunction with this FIGURE 3 may be used with a plurality of 

25 sensor stations. Image capture engine 34 may selectively perform the method using 

some or all of these sensor stations as desired. 

Although steps 300-310 are illustrated as separate steps, various steps maybe 
ordered in other logical or functional configurations, or may comprise single steps. 
For example, image capture engine 34 may capture image and reference feature data 

30 from film 60 and then adjust the image data in response to the feature data after all 

data has been captured from film 60, or after each pixel, column, or two-dimensional 
region has been captured, as desired. Alternatively or in addition, image capture 
engine 34 may create, identify, and/or locate reference feature data from the film and 
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then adjust image data in response to the feature data while it is capturing data from 
film 60. Identification and/or location of applicable features may be performed 
during various steps within the method, and by using a variety of methods. Image 
capture engine 34 may also dynamically vary the frequency for identification and/or 
5 location of these features as desired. Steps 300-310 comprise one embodiment of a 

method for obtaining and adjusting image data by image capture engine 34 that will 
be used to illustrate one aspect of the invention. 

In step 300, one or more time invariant features such as fixed reference point 
70 and/or exposed region 71 may optionally be created. For example, exposed region 

10 71 may be created at a selected position on film 60 to measure dark levels to estimate 

a low level for the dynamic range of film 60. This estimates may be established by 
obtaining a plurality of readings within the region, such as a column, from exposed 
region 71, or obtaining substantially all data therefrom, whether or not a chemical 
developer has been applied. To illustrate, light source 50 may be illuminated, and 

1 5 sensor 52 may capture a plurality of columns of readings of light reflected from 

exposed region 71. Image capture engine 34 may then average these columns to 
desirably improve this dark level estimate, because each detector is typically subject 
to random noise, and film 60 is typically not uniform. This step may be omitted in 
some embodiments of the invention, or performed at other stages, such as is discussed 

20 in conjunction with step 702. 

In step 301, image capture engine 34 may initialize sensor 52 and light source 
50. For example, image capture engine 34 may optionally allow sensor 52 and/or 
light source 50 to adjust to equilibrium, and/or adjust and/or set sensor and 
illumination levels for a film type. To illustrate, image capture engine 34 may adjust 

25 and/or set an integration time of sensor 52 and/or an illumination power of light 

source 50 for an expected density of the film type and expected signal strength. These 
adjustments may desirably prevent saturation of sensor 52 during capture of image 
data in image regions within film 60. 

In step 302, image capture engine 34 may optionally detect, or identify, 

30 applicable time invariant features. For example, image capture engine 34 may use 

leader 73 to estimate the density of film 60, and to measure white levels to estimate a 
high level for the dynamic range thereof. Image capture engine 34 may then 
determine initial estimates for the dynamic range of illumination values to be 
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expected. These estimates may also be established by obtaining a plurality of 
readings within a region, such as a column, from leader 73, or obtaining substantially 
all data therefrom, whether or not a chemical developer has been applied, and/or by 
averaging these readings. Image capture engine 34 may later use these white and dark 
5 level estimates to perform equalization and/or normalize gains across selected 

columns of image data to reduce variations across the image data. 

To facilitate location of applicable features, image capture engine 34 may 
identify expected regions of each data column as or after data is captured. For 
example, image capture engine 34 may generally break down a portion of a data 

10 column into at least two areas — an image column and an unexposed column. These 

areas generally correspond to an unexposed region R t and image L, as discussed in 
FIGURES 2A-2C. Optionally, a data column may be further broken down into a third 
area corresponding to unexposed region Rt,, as illustrated in FIGURES 2A-2C. These 
areas may be used locate features in film 60 by a method such as the one discussed in 

1 5 further detail in conjunction with FIGURE 6. 

In addition, image capture engine 34 may adaptively identify and/or locate 
various time-invariant features as the film develops. For example, where a plurality 
of sensor stations is utilized as illustrated in FIGURE 2C, image capture engine 34 
may utilize adaptive thresholds and/or expected signatures to locate unexposed 

20 regions between image frames. This information then may be used to predict the 
location of an image frame before data within the frame is captured. 

In step 304, image capture engine 34 begins capturing data from film 60, by 
illuminating film 60 using light source 50 and capturing data with sensor 52. As 
previously discussed, a generally linear array sensor 52 may obtain a data or image 

25 column along the y direction of film 60 as illustrated in FIGURES 2A-2C. Film 60 

may be moved at a scan rate relative to sensor 52 in the x direction as illustrated in 
FIGURES 2A-2C to obtain a two-dimensional plurality of columns for each latent 
image in film 60. Image capture engine 34 may use an imaging window of a length of 
time sufficient to obtain a desired resolution, such as 12 um per square pixel. For 

30 example, if a square pixel is desired, optics 46 and a generally linear sensor 52 may be 

suitably adjusted to obtain data in the y direction of 12 um. Then, image capture 
engine 34 may adjust the scan rate to obtain the desired resolution of 12 urn in the x 
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direction. At a next imaging window, sensor 52 may capture a next column of data 
from film 60, and repeat this process until all image data from film 60 has been 
captured. Alternatively, image capture engine 34 may capture two-dimensional image 
data from film 60 by using a similar process utilizing a two-dimensional sensor 52, 
5 such as a staring array, to obtain image data for a two-dimensional region from film 

60. 

In step 306, image capture engine 34 optionally determines whether all image 
data from film 60 has been captured. For example, the invention also contemplates 
on-the-fly image data adjustment. That is, image capture engine 34 may adjust image 

10 data after some or all of the image data has been captured from film 60. hi this 

example, if all image data has been captured, image capture engine 34 proceeds to 
step 308 to continue the method. If not, image capture engine 34 returns to step 302. 

In step 308, image capture engine 34 may optionally detect, or identify, 
applicable time invariant features after all data has been captured. For example, 

15 image capture engine 34 may decimate the data in order to locate features in film 60 

by methods such as the ones discussed in further detail in conjunction with FIGURES 
5 and 6. Image capture engine 34 may reduce the time necessary to accurately locate 
features by performing the method in this step. 

Image capture engine 34 may perform adjustments in step 310 to image data 

20 captured in response to the time invariant features detected and/or located in steps 

300-308. The image adjustment described herein may be performed on image data 
captured by image capture engine 34 or received by processor 36. Although three 
embodiments of exemplary image capture engines 34 that may be used for image 
adjustment in connection with the invention have been illustrated, other image capture 

25 engines may be used without departing from the scope of the invention. 

Processing may be performed as desired, including, but not limited to, a pixel, 
array (such as a data column), or image frame basis. Processing may also be 
performed in parallel or pipelined. Adjustment includes, but is not limited to, 
reduction of errors or other alterations of pixel data in the captured image. To 

30 illustrate this aspect of the invention, adjustment is performed on image data captured 

in data columns by a generally linear sensor that comprises a plurality of detectors. 
Captured and/ or adjusted image data, as well as data captured for estimates and 
updates, may be stored as pixel values representing the measured sensor illumination 
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levels. These data may be stored in non- volatile memory such as storage medium 38 
for subsequent processing, and/or stored in RAM 36a, ROM 36b, or in other storage 
media within image capture engine 34 for near-simultaneous processing. 

Some or all of these time invariant feature data may be used by one of many 
5 methods to normalize image data across detectors within sensor 52 to provide a 

uniform gain therein. Normalizing the gains of captured image data may also avoid 
overflow in calculations. For example, image capture engine 34 may use a variety of 
statistical methods to determine a best value for measured dark and white levels. For 
example, averaging of illumination or pixel values representing the dark and white 

10 levels, or an equivalent thereto, may reduce or eliminate other high frequency defects 

that may be due to external factors. Image capture engine 34 may apply a gain factor 
to the image data at prior, identical, or subsequent image capture times. For example, 
image capture engine 34 may determine a new gain factor or gain level from the data 
captured from unexposed region 73 and exposed region 71. The new gain level may 

15 be calculated by a variety of known methods, using pixel values, illumination levels, 

or a combination thereof. 

For example, the new gain level may be obtained by adding to the pixel value, 
as measured by the sensor, a difference value. The difference value may be 
represented by the relationship 1/ (Difference between the measured pixel value and 

20 the desired pixel value). The desired pixel value may be a predetermined value, or an 

averaged value. For example, the desired pixel value may be an average of all of the 
detector values within a captured data column in the y-direction in either exposed 
region 71 or exposed region 73. As another example, image capture engine 34 may 
utilize a histogram that includes the best black and white values to determine a gain 

25 level or gain factor with which to adjust the captured data. Depending on the gain 

factor used, adjustment may be performed by, for example, multiplying the gain 
factor by the captured image data or subtracting the gain factor from the captured 
image data. Image capture engine 34 may then apply this new gain level to each pixel 
of image data captured from one or more prior or subsequent image frames. The new 

30 gain level may be calculated by a variety of known methods, using pixel values, 

illumination levels, or a combination thereof. 

Where a plurality of sensor stations are used, image data captured by each 
sensor station may be normalized independently. Such independent processing may 
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be desirable, for example, where image capture engine 34 may utilize different 
parameters for each sensor station such as light sources using various wavelengths, 
and/or sensors with varying integration times. When a plurality of sensor stations are 
used, each representation of an image captured by a sensor station may be recombined 
5 and/or undergo other processing to form a single representation of the image. 

Image capture engine 34 may also similarly utilize some, none, or all of these 
best dark and white levels to determine a best gray scale to use when equalizing the 
captured image data, and/or to determine maximum and/or minimum thresholds. 
These thresholds may be used to locate a variety of time invariant features, as is 

10 discussed in conjunction with FIGURES 4-6. For example, thresholds may be used 

where expected signal patterns are used to determine the location of features such as 
sprocket hole 76. These best dark and white levels may be used to adaptively change 
these thresholds as film 60 develops. 

In addition, statistics may be used in noise or defect correction to eliminate 

15 anomalous data that may be due to factors such as nonuniformities of applied 

developer chemicals, light leakage, flares, scratches, and the like. For example, in 
some cases, flares may be present in film 60. Because flares typically develop more 
slowly over time than image data as film 60 develops, image capture engine 34 may 
detect this changing data within a region that would otherwise have been expected to 

20 be an unexposed region. For example, image capture engine 34 may detect such 
activity by producing and comparing a histogram within each unexposed region as 
film 60 develops, by using a plurality of sensor stations. Image capture engine 34 
may then accordingly adjust the captured image data to eliminate the anomaly, even 
within an image frame. 

25 Image capture engine 34 may also utilize a variety of statistics, such as a mean 

and/or standard deviation, to establish and/or adaptively change an expected signature 
of a feature. These statistics may include, but are not limited to, the sizes and/or 
repetition intervals for time invariant feature data such as the location of sprocket 
holes 76, and/or unexposed regions Ru. These statistics may be gathered within prior 

30 values and/or repetition intervals that have previously been determined. These prior 
values may also have been determined from similar films 60, various views, a prior 
sensor station at another film development time, and the like. 
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FIGURE 4 illustrates an example of a method for locating an unexposed 
region of film while the film is developing utilizing the teachings of the present 
invention. Image capture engine 34 may generally locate none, some, or all 
unexposed regions of film that usually occur between adjacent images. Image capture 
5 engine 34 may utilize several parameters, such as fixed reference point 70, to detect 

these locations, in some cases, early within the development process. Generally, 
image capture engine 34 may seek an unexposed region, such as a leader or gutter of 
film 60, by capturing a plurality of sensor readings and comparing them to a 
threshold. When the threshold is exceeded, image capture engine 34 identifies a 

10 candidate gutter region. After image capture engine 34 identifies a candidate gutter 

region, image capture engine 34 then seeks the next latent image frame region, which 
signals the edge of the gutter region. The method may optionally utilize a variety of 
parameters and/or counters to establish expected widths of gutters and images, which 
may be used to detect subsequent gutter locations. These expected widths may also be 

15 used to adjust image data that may have been captured early in the development 

process of film 60. A generally linear array sensor 52, operable to capture a data 
column from film 60 as film 60 is moved at a scan rate relative to the sensor, is used 
to describe this aspect of the invention. As discussed previously, the invention also 
contemplates the use of two-dimensional sensors that move at a scan rate relative to 

20 film 60, and staring arrays. The method may be performed for one or more views, 

and/or one or more sensor stations. 

The method begins at step 702, where fixed reference point 70 may optionally 
be created and positioned at step 702. Fixed reference point 70 may comprise any 
suitable indicia that may be detected by image capture engine 34, such as tape 

25 operable to absorb the wavelength of the light source. Thus, the location of the fixed 

reference point may be perceived both by a sensor capturing light reflected from, as 
well as a sensor capturing light illuminated through, film 60. Tape 70 may be, for 
example, infrared absorbing tape such as Lab Depot Opaque Tape 12-200, and may 
be disposed, affixed or coupled to either top portion 64 or bottom portion 66 of film 

30 60 as illustrated in FIGURES 2A-2C. Fixed reference point 70 may also comprise a 

physical edge of film 60. As discussed previously in conjunction with FIGURES 2A- 
2C and 3, the reference point may also comprise any number of time-invariant 
reference features that may be detected by various methods, including but not limited 
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to markings such as holes, notches or slits cut into or delineated on film 60. Because 
the fixed reference point virtually absorbs the wavelength of the light source, readings 
captured by a sensor from the fixed reference point typically measure zero, or near 
zero. These near-zero measurements may provide a strongly contrasting signal 
measurement to any region on film 60, especially near unexposed regions of film 60, 
where sensor readings typically comprise white levels. 

Because unexposed film is very reflective when illuminated with infrared 
energy, usually the signal values within an image area are significantly below those 
within a gutter region. Image capture engine 34 may begin capturing a plurality of 
readings from film 60 shortly after deposition of developer on the film. Values for a 
plurality of detector readings in a generally linear array may be held in a buffer or 
storage medium 38 for processing and comparison with subsequent data columns. In 
step 704, image capture engine 34 begins seeking a first gutter edge. For example, 
image capture engine 34 may capture a first column of data from film 60, and 
determine a representative value, such as a mean value, for the first data column. In 
step 706, image capture engine 34 then captures a next column of data from film 60 
and determines a representative value, such as a mean, for the next data column. 
Image capture engine 34 then in step 708 compares the representative values and 
determines the greater of the two. Image capture engine 34 then identifies the column 
with the larger representative value as a candidate gutter portion. Image capture 
engine 34 may hold the next data column for comparison with successive data 
columns to be captured from film 60. If the representative value of the first data 
column is smaller than that of the second data column, image capture engine 34 
returns to step 706 to capture a new next data column. 

If the representative value of the first data column is greater than that of the 
second data column, image capture engine 34 then determines in step 710 whether the 
larger representative value exceeds a threshold. Typically, because signal values 
within a latent image frame region are significantly below those within a gutter region 
of film 60, the threshold may be set at a pixel or illumination level value that is 
reasonably high. For example, the threshold may be predetermined to be a level 
approximately equal to, for example, 90% of the white level value. The threshold 
may also be dynamically determined. For example, film becomes more dense as it 
develops, and image capture engine 34 may decrease the minimum threshold used to 
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identify the latent image edge for a gutter as the illumination levels within image 
regions measurable by the sensors correspondingly decrease. In this case, image 
capture engine 34 may desirably adaptively change values for the threshold over time 
to accommodate variances in the development process. 
5 If the larger representative value exceeds the threshold, image capture engine 

34 identifies the next data column as a candidate portion of an unexposed region in 
step 712. If not, image capture engine 34 returns to step 706 to capture a new next 
column of data. 

Image capture engine 34 then captures an additional column of data in step 

10 714, and repeats the process of determining the greater of the two representative 

values of last two data columns read and whether the greater representative value 
exceeds the threshold. This process continues until a candidate threshold has been 
reached, at which point image capture engine 34 identifies the candidate portion as a 
gutter region in step 718. That is, enough comparisons have been made to identify a 

15 candidate gutter region. If the candidate threshold has not been reached, image 

capture engine 34 adds the data column with the larger representative value to the 
candidate gutter portion in step 717 and continues the process in step 714. 

The number of comparisons desirable to determine the candidate threshold 
may vary where film 60 is developing. For example, the number of comparisons may 

20 be large where the film has not yet developed to generate sufficient contrast data 
between images and gutter regions. On the other hand, image capture engine 34 may 
be able to identify a gutter edge by fewer captured data columns as the film more fully 
develops in steps 712-716. 

Furthermore, image capture engine 34 may optionally also use adaptive methods 

25 to count the number of expected columns in each gutter and each image within the 

film. Image capture engine 34 may adaptively change these values until all image 
data is captured, and/or from sensor station to sensor station. For example, such as 
where film 60 has developed sufficiently to provide an expected width for an 
unexposed region at a given scan rate and pixel resolution, a gutter region may be of a 

30 definite value, such as 150 columns of data. 

Image capture engine 34 may use a variety of methods to determine a 
sufficient number of comparisons. For example, image capture engine 34 may also 
utilize an actual or assumed knowledge of the scan rate and image motion to calculate 
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an expected number of columns in a gutter region as well as an expected number of 
columns in an image. Image capture engine 34 may also utilize one or more counters. 
These counters may include, but are not limited to, counters that track the number of 
data columns that have exceeded the threshold, track the number of data columns that 
5 have been captured, and the number of data columns that may be expected in the 

gutter region, and the number of data columns expected within an image frame. 

For example, image capture engine 34 may choose to disable the gutter 
location feature and avoid performing any adjustments that might have been made to 
subsequently captured image data, if the expected count values are not properly 

10 achieved. Thus, when the number of columns to be expected for a gutter is known, 

the count of the number of columns exceeding the threshold can be compared. If the 
threshold is not exceeded before the count reaches the expected number, then the 
counter should be reset and the search begins anew. Then, image capture engine 34 
may verify that the columns comprise a gutter location by counting the number of 

15 consecutive columns that exceed the threshold. Similarly, image capture engine 34 

may use the counters to verify initial and final boundaries for an unexposed region of 
film 60, where the unexposed regions are typically regularly spaced and/or regularly 
sized. For example, commercial films 60 may typically comprise a gutter region 150 
columns wide, where pixels generally comprise a resolution of 12u, 

20 Because a gutter width is typically wider than one column, once image capture 

engine 34 has identified a candidate portion as a gutter region, image capture engine 
34 next seeks and locates the trailing boundary of the gutter in steps 720-724. This 
trailing boundary typically abuts the first edge of the next latent image frame. Image 
capture engine 34 captures an additional data column in step 720, and determines 

25 whether a representative value of the data column exceeds the threshold in step 722. 

If the representative value of the data column does not exceed the threshold, image 
capture engine 34 determines that the data column is still within the gutter region, and 
returns to step 720. Image capture engine 34 continues to capture data columns in a 
similar manner until the representative value of the additional data column exceeds 

30 the threshold in step 722. Again, image capture engine 34 may optionally utilize a 

counter to track the number of data columns that have been determined to be within 
the gutter region, and exit the process as desired, when, for example, expected count 
values have not been properly achieved. 

DAL01:502810.1D 
021971.0166 



ATTORNEY DOCKET NO.: PATENT APPLICATION 

021971.0166 ASF99246-PA 
27 

When the representative value of the data column falls below the threshold, 
image capture engine 34 then identifies the data column as a first column of a next 
image in step 724. Image capture engine 34 may also optionally identify the next-to- 
last data column as a candidate end of the unexposed region in step 724. 

Image capture engine 34 may then verify the end of the unexposed region in 
step 726. For example, image capture engine 34 may compare a counter that has 
tracked the number of data columns that have been determined to be within the gutter 
region with a number of expected columns for a gutter. Alternatively or in addition, 
image capture engine 34 may initiate a counter to track the number of columns in the 
image, and begin the search for the next gutter edge. When image capture engine 34 
identifies a new candidate portion of an unexposed region, image capture engine 34 
may compare this counter to the expected width of the image to verify that a proper 
identification for the image has been made. Image capture engine 34 may also verify 
that the image is properly located between two actual gutter regions. 

The invention contemplates the use of representative values such as 
arithmetic, geometric, or any other type of mean value, or order statistics, etc. In 
addition, the mean may be measured over one or more columns of data captured. 
Furthermore, image capture engine 34 may use a variety of statistical variants, such as 
standard deviations of the widths and/or the repetition pattern for prior gutter regions, 
to more effectively identify a next gutter region. 

Image capture engine 34 may also utilize parameters such as the scan rate and 
fixed reference point 70 identified in optional step 702 to more effectively identify the 
location of one or more gutter regions within film 60. For example, image capture 
engine 34 may utilize time invariant feature data such as fixed reference point 70 to 
form a template to predict when to expect and/or verify that a column of data is 
located within an image and/or a gutter region. Such a template may improve the 
robustness of the method by, for example, adaptively decreasing the number of 
columns necessary to identify a candidate gutter region. 

Image capture engine 34 may determine a location on film 60 of fixed 
reference point 70 relative to a location where image data is captured from the film. 
For example, image capture engine 34 may determine an offset in pixels or in 
absolute distance from the fixed reference point to another point to determine the 
location on film 60 of a data column. For example, the fixed reference point may be 
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used in conjunction with time invariant features such as the small spheres Si 
discussed in FIGURE 2A, image extents Ti and B u and/or sprocket holes 76, as 
described in conjunction with FIGURES 5 and 6. Because of their periodic nature, 
image capture engine 34 may utilize these values to predict the location of gutter 
regions using sensor stations 40a and/or 40b. In some applications, it may be 
desirable to measure this offset to a sprocket hole 76, because sprocket holes 76 are 
typically regularly spaced within commercial films 60. As a result, image frames are 
typically regularly sized with regard to sprocket holes. For example, commercial 
films 60 typically include image frames that are approximately eight sprocket holes 
wide. Although where each image frame begins with regard to the sprocket holes 
may depend on how a camera was loaded, an initial offset, such as three pixels, may 
be sufficient to determine an exact location of the image frames relative to each 
sprocket. Then, a relative spacing, in pixels or in absolute distance, may be measured 
from the nearest sprocket hole to a candidate gutter location. 

Alternatively or in addition, the offset may be measured from the fixed 
reference point to a sensor station. For example, image capture engine 34 may 
comprise a plurality of sensor stations that capture image data at various film 
development times as described in FIGURE 2C. Moreover, the scan rate for each 
sensor station may also be vary slightly, due to factors such as variance in motor 
speeds that may move film 60. As a result, the distance measurable in pixels between 
sprocket holes may vary slightly from sensor station to sensor station. Image capture 
engine 34 may utilize parameters such as scan rate, resolution, and absolute distances 
between each sensor station 40a and 40b to appropriately calculate the offset. 

In some applications, image capture engine 34 may also use the offset to 
retroactively identify gutter regions for other sensor stations. For example, image 
capture engine 34 may monitor development times for sensor stations 40a and/or 40b. 
Image capture engine 34 may determine at sensor station 40b that development time 
is sufficient to delineate at least one gutter region and may determine a first gutter 
location utilizing sensor station 40b. Because the film may be moved relative to 
sensor station 40b at a different rate than sensor station 40a, image capture engine 34 
may utilize the scan rates for sensor station 40b to determine location of the gutter 
location relative to the fixed reference point. 
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Image capture engine 34 may then utilize the fixed reference point to 
determine where the gutter location is relative to sensor station 40a. Image capture 
engine 34 may utilize this approach to conclusively locate unexposed regions in film 
early in the chemical development process. Knowledge of these locations may be 
used to save memory and processing power for the regions of film that comprise 
useful information content, and to adjust image data that may have previously been 
captured by sensor stations 40a and/or 40b, as discussed in conjunction with FIGURE 
3. 

FIGURE 5 illustrates an example of a method for locating the top and bottom 
extents of images in accordance with the present invention. Although the method is 
illustrated as separate steps, various steps may be ordered in other logical or 
functional configurations, or may comprise single steps. Image capture engine 34 may 
perform the method after all image data has been captured from film 60, whether 
captured or received by image capture engine 34. Alternatively or in addition, image 
capture engine 34 may perform these steps while capturing data from film 60. 

The method begins at optional step 800, where image capture engine 34 
creates a thumbnail image TNi from the total captured image data by one of a number 
of known methods. For example, image capture engine 34 may decimate the total 
captured image data from film 60 by some desirable factor, such as eight. Thumbnail 
image TNi then comprises roughly 1/64 of the total captured image data from film 60. 
This reduction of data through creation of thumbnail image TNi may be desirable in 
some applications. For example, it may increase computing efficiency and reduce 
computing time and/or processing resources for locating image extents. As another 
example, it may improve the accuracy of image extent location along the x direction 
of film 60. 

hi steps 802-808, the method then creates a representative data column 
I F with which to perform the remaining steps of the method. These values are 
obtained across at least a portion of width W of film 60. These values may be a single 
data column I x } as illustrated in FIGURES 2A-2C, a decimated data column Id (y , n ), 
or representative values such as sums derived from a plurality of data columns, 
whether decimated or not. hi step 802, image capture engine 34 selects a first value 
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y iv A first value y f which represents an ith pixel within a single data column captured 
across width W in the y direction is used to illustrate this aspect of the invention. 

Image capture engine 34 then may optionally sum each of the ith pixel data 
values in the x direction in step 804 to create a representative data value for y ; . In step 
806, image capture engine 34 determines whether or not all values in the y direction 
have been summed. If not, in step 808 image capture engine 34 selects the next value 
y i+1 and then repeats the summing step in 804 for the y i+ i pixel data values in the x 
direction. If all values in the y direction have been summed in step 806, image 
capture engine 34 proceeds to step 810. Summing each of the ith pixel data values in 
the x direction in step 804 may also be advantageous in some applications. For 
example, it may increase extent location computing efficiency and accuracy, and/or 
reduce computing time and/or processing resources. 

In step 810, image capture engine 34 computes a pairwise rate of change, or 
derivative, dj between each representative value y ; and y i+ i determined in steps 802- 
808. These pairwise rates of change may be used to identify one or more relative 
maximum values from which one or more extent locations may be derived. Derivative 
dj may be computed by using a number of known methods. In some applications, 
derivative d\ may be calculated by constructing slopes between selected values yi and 
y i+1 and dividing the values by a number of piecewise linear segments that can be 
constructed therebetween. For example, a single piecewise linear slope may result in 
a derivative d; = (yi + yi+i)/2. 

The method may locate a first relative maximum value V r i by searching 
through these pairwise rates of change from a location within width W such as the 
center of film 60 out towards top edge 72. The method then may establish the 
location of a top edge T in response to the first relative maximum value V rt . 
Similarly, the method may locate a second relative maximum value V r2 by searching 
through these pairwise rates of change from the same or a different location within 
width W out towards bottom edge 74. The method then may establish the location of a 
bottom edge B in response to the second relative maximum value V r2 . 

In step 812, image capture engine 34 determines the location of a closest 
relative maximum value V r i between top edge 72 and a selected point, such as center 
pixel y c . The invention contemplates many methods for determining whether value 
V r i is a relative maximum with respect to a maximum value V M within the pairwise 
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rates of change. For example, the term relative may be used by the method to mean a 
desired fraction of, or predetermined threshold with respect to, a maximum value V M , 
or an absolute value thereof. For example, value V rt may be a relative maximum if it 
satisfies the relationship: 



Vri >= 1-25 x V M | 



A variety of statistical methods may also be used to determine whether value 
V r i is a relative maximum. For example, image capture engine 34 may calculate a 
mean and/or standard deviation for maximum values V M and/or values V ri within 
prior pairwise rates of change that have previously been determined, and then 
determine an appropriate threshold. These prior pairwise rates of change may have 
been determined from similar films 60, various views, a prior sensor station at another 
film development time, and the like. Image capture engine 34 may determine that V r] 
is a relative maximum if it meets the appropriate threshold, such as a value that 
exceeds a mean for prior measurements of V r i. In addition, statistics may be used to 
eliminate anomalous data that may be due to factors such as nonuniformities of 
applied developer chemicals, light leakage, flares, scratches, and the like. 

Value V r i is desirably the closest relative maximum value to the selected 
point. For example, value V rt may be a first relative maximum found by searching in 
a positive y direction from the selected point to top edge 72. Alternatively, value V ri 
may be a last relative maximum found by searching in a negative y direction from top 
edge 72 to the selected point. In step 814, image capture engine 34 may similarly 
determine a location of a second closest relative maximum value V r2 that is closest to 
the same or a different selected point and in between that selected point and bottom 
edge 74. 

Image capture engine 34 may use a variety of selected points. For example, 
the selected point may be the center pixel y c . It also may be desirable for image 
capture engine 34 to utilize different pixels within the representative data column. As 
one example, image capture engine 34 may utilize a first selected point approximately 
one-third width W from top edge 72 of film 60 to locate V r i, and a second selected 
point approximately one-third width W from bottom edge 72 of film 60 to locate V r2 . 
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In step 816, image capture engine 34 identifies at least a portion of top edge Ti 
and bottom edge T 2 using values V rt and V r2 . For example, image capture engine 34 
may identify the locations of values V r i and V r2 as at least a portion of top edge T t and 
bottom edge T 2 , respectively. On the other hand, it may also be desirable to add to the 
locations of values V r i and V r2 some offset value. This value may more precisely 
locate at least these portions of top edge Ti and bottom edge T 2 , where, for example, 
there are inaccuracies in the data capture process such as misalignment or noise. This 
value may also reduce inaccuracies caused by slower-than-normal rates of change, 
which may be due to factors such as light leakage when the image data was originally 
captured on film. 

Image capture engine 34 may also select a variety of different values y and 
y i+ i to perform steps 810-816. For example, image capture engine 34 may omit steps 
804-808 and perform the method using each of decimated values yj and y i+ i from step 
800 for column I F . Image capture engine 34 may also perform steps 810-816 using 
original data values y t and y i+ i for column where, for example, it may be 
desirable to perform the method as image data is captured. Alternatively or in 
addition, the method may in some applications utilize fewer computational resources 
when using decimated image data. 

Image capture engine 34 may use objects, tables, or arrays, and/or any suitable 
method to keep track of data values, maximum and relative maximum values, 
pairwise rates of change, and the like. These values may also be denoted by tracking 
the positions of these values in graphical form. Any type of data structure may also 
be used for the captured image data, image frames, unexposed regions, unexposed 
regions, and/or top and/or bottom edges. 

FIGURE 6 illustrates an example of a method for locating time invariant 
features in film using an expected signature in accordance with the present invention. 
Although the method is illustrated as separate steps, various steps may be ordered in 
other logical or functional configurations, or may comprise single steps. Image 
capture engine 34 may perform the method after all image data has been captured 
from film 60, whether captured or received by image capture engine 34. 
Alternatively, or in addition, image capture engine 34 may perform these steps while 
capturing data from film 60. 
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The method begins at step 900, where image capture engine 34 creates a 
thumbnail image TNi from the total captured image data, as discussed above in 
conjunction with FIGURE 5. Creation of thumbnail image TNi may desirably 
increase computing efficiency and reduce computing time and/or processing resources 
for locating image features. 

In step 902, the method then selects an area in which data was captured from 
film 60. These areas, as previously discussed in conjunction with FIGURE 2A, 
include image areas Ii-I n and an unexposed region such as R t . Data captured within 
image areas Ii-I n may be used to locate one or more unexposed regions R u , while 
unexposed regions R t may be used to locate one or more sprocket holes 76. 

In steps 904-908, the method then creates a representative data column I F ( X , n) 
with which to perform the remaining steps of the method. These values are obtained 
across at least a portion of length L of film 60. These values may be a single row of 
pixels in the x direction, or representative values derived from a plurality of pixel 
rows. In step 904, image capture engine 34 selects a first value x is which represents 
an ith pixel within a single pixel row captured across length L in the x direction. 

Image capture engine 34 then may optionally sum each of the ith pixel data 
values in the y direction in step 906 to create a representative data value for xj. In step 
908, image capture engine 34 determines whether or not all values in the x direction 
have been summed. If not, in step 909, image capture engine 34 selects the next value 
x i+ i and then repeats the summing step in step 906 for the x i+ i pixel data values in the 
y direction. If all values in the x direction have been summed in step 908, image 
capture engine 34 proceeds to step 910. Summing each of the ith pixel data values in 
the y direction in step 906 may also be advantageous in some applications. For 
example, it may increase accuracy in computing efficiency for location of features 
such as sprocket holes 76, and/or reduce computing time and/or processing resources. 

In step 910, image capture engine 34 computes a pairwise rate of change, or 
derivative d si between each representative value x, and x i+ i determined in steps 904- 
908. These pairwise rates of change may be compared with expected signatures from 
a selected feature, and then used to derive the location of the selected feature. As 
discussed previously in conjunction with FIGURE 5, derivative d si may be computed 
by using a number of known methods. 
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In step 912, image capture engine 34 compares d S j with a signature for a 
selected area. This comparison may be made using a number of methods, such as 
edge detection filters or masks. One such filter or mask may include a Marr-Hildreth 
edge detector. 

While specific values for a signature of a selected feature vary according to a 
number of parameters, each feature may have a generally recognizable signature. For 
example, because sprocket holes 76 are typically regularly shaped and/or spaced 
along the x direction of film 60, the occurrences of sprocket holes 76 may appear 
generally similar, and at a generally periodic interval. For example, the rates of 
change measured for data captured across each sprocket hole 76 result in a large 
negative peak followed by a generally flat region. This generally flat region is 
subsequently followed by a similarly large positive peak. As data is captured across 
subsequent sprocket holes 76, this pattern may generally be repeated at the location of 
each sprocket hole 76. The positive and negative peaks represent data at each edge of 
sprocket hole 76, while the generally flat region represents an area within sprocket 
hole 76, where the data is generally not changing. In some applications, this generally 
flat region may be of a predetermined size, such as for commercial films 60, where 
sprocket holes 76 are typically of a standard size. 

A similar signature may be found for other features such as an unexposed 
region R u . For example, in commercial films unexposed regions R u are also typically 
regularly shaped and/or spaced along the x direction of film 60, and occurrences 
thereof may appear generally similar, and at a generally periodic interval. For 
example, the rates of change measured for data captured across each unexposed 
region R u result in a large positive peak as data values increase when leaving an 
image frame, followed by a generally flat region. This generally flat region is 
subsequently followed by a similarly large negative peak as data values decrease 
when entering an image frame. 

Similar to sprocket holes 76, this pattern may generally be repeated at the 
location of each unexposed region R u . The generally flat region represents an area 
within unexposed region R u , bounded by the positive and negative peaks at each edge. 
In some applications, this generally flat region may be of a predetermined size, such 
as for commercial films 60, where unexposed region R u may be generally similarly 
sized. 
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A variety of statistical methods may also be used to determine an expected 
signature for a selected feature. For example, image capture engine 34 may calculate 
a mean and/or standard deviation for sizes and/or repetition intervals for sprocket 
holes 76, unexposed regions R u and/or image frames. These statistics may be 
5 gathered within prior values that have previously been determined, and an appropriate 

threshold may then be determined for each peak and/or flat region, a spacing 
therebetween, and/or a repetition interval. These prior values may also have been 
determined from similar films 60, various views, a prior sensor station at another film 
development time, and the like. In addition, statistics may be used to eliminate 

10 anomalous data that may be due to factors such as nonuniformities of applied 

developer chemicals, light leakage, flares, scratches, and the like. 

In step 914, image capture engine 34 determines the location of a selected 
feature in response to the comparison. The location of the selected feature may be 
identified in a variety of ways. For example, image capture engine 34 may identify 

15 the location as a center of the flat region, and/or use the peak locations to delineate the 

selected location. Alternatively or in addition, image capture engine 34 may also 
utilize offsets as discussed above in conjunction with FIGURES 4 and 5 to identify 
the location of the selected feature. These offsets may be calculated as predetermined 
values, statistical variations thereof, and/or from various views, sensor stations, and 

20 the like. 

Image capture engine 34 may also use any type of data structure or method 
such as objects, tables, or arrays, to keep track of data values, peak and flat region 
values, repetition patterns, and the like. These values may also be denoted by 
tracking the positions of these values in graphical form. 
25 While the invention has been particularly shown by the foregoing detailed 

description, various changes, substitutions, and alterations may be readily 
ascertainable by those skilled in the art and may be made herein without departing 
from the spirit and scope of the present invention as defined by the following claims. 
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